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Problem Statement 


Description of the problem: 

• s(n ) = [s t (n), s 2 (n), ...,%(n)] r 

• x(n ) = [x 1 (n),x 2 (n), ...,x N ( 7 i)] r = ^[5(72)] 


Estimate 5(71), given x(ri) and information on 
the sources and/or mixture process. 



Problem is blind if mixing model is unknown. 
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Problem Statement 


• Application to chemical sensor arrays: 


Ion-selective electrodes (ISE) used to measure 
concentration of ions. 


reference 

(sample)' 



- | potentiometer^ 


reference 

(internal) 



ion-selective 

membrane 


Problem Statement 


Application to chemical sensor arrays: 

• Concentrations roughly follow Nicolsky-Eisenmann 
equation: 


RT 

xt = E t +— In I s 
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Zi is the valence 


Equation is empirical and only approximates actual 
mixing model 
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Problem Statement 


Application to chemical sensor arrays: 

• Mixture can be adjusted to become polynomial (in 

1/Zj> 

Pi = V ): 


X 


/ \ N 

modified ( , \ ' z; 

i =expl (x i -E i )—\=2_ i a ijP j l 

^ ' j = 1 


The modified mixture is polynomial in pj, with 

. max(z) 

degree . 

gcd(z) 


Algorithms 


For the specific case: 

• 2 sources 

• Both have the same valence 


The modified mixture is linear can be solved 
by standard methods of BSS. 


However, NE equation is only an 
approximation... 


Algorithms 


We assume the mixture is almost linear. 


A second-order polynomial might be able to 
correct the inaccuracies. 
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Algorithm: specific case 


Basic idea of the algorithm: 

• Estimate the parameters minimizing mutual 
information (gradient-based algorithm): 


dy ^ 

w/c+1 = w/c - jiE { — Py(y) 


dvj 


where 


/5y,( y) = 


aiogp(y) 


d log p(y/) 


dy: 


dy; 


The score functions can be calculated via efficient 
methods as described in [Pham, 2004] 
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Algorithm: specific case 




The derivative 


dy 

dw 


can be found from the mixing 


model supposing y = s : 

x = Ay + By 0 2 + c y 1 y 2 

Using implicit differentiation: 


0 = yA + 2B © diag(y ) + c 
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Algorithm: specific case 


• Use a recurrent network to find estimates for 
the specific set of weights found. 

• Network based on Newton-Rhapson root- 
finding algorithm for nonlinear equation 
system: 


C[5] = As + Bs° 2 + CS 1 S 2 — x = 0 


Algorithm: specific case 


• Recurrent network is: 

yic+i = Vk -Js'iy^Siyk] 

• Jr is the Jacobian of the mixing model 


Locally stable for all points 


Algorithm: specific case 


• Proposed algorithm: 

1. Start with random parameters 

2. Use recurrent network to find y 

3. Use mutual information gradient to update 
parameters. 

4. Repeat steps 2 and 3 until convergence. 
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Simulations: specific case 
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Activity 


Simulation: specific case 




Algorithm 

SIR Si (dB) 

SIR s 2 (dB) 

PNL 

11.0 

10.6 

Proposed 

16.3 

11.1 


Compared to the previous 
algorithm (PNL), the proposed 
algorithm shows promising 
results 





Algorithm 


• Good results, but hypotheses are somewhat 
limiting. 

• A more general version of the algorithm can 
be performed to allow for: 

• More than 2 sources; 

• Ions with different valences. 


Algorithm: general case 


• For different valences, we can use a higher degree polynomial 
instead: 


• Zj = 2 -> 3 rd degree polynomial 

• Zj = 3 -> 4 th degree polynomial 

• Example (3 rd degree): 


x = As 4- Bs° 2 4- Cs ° 3 + D 
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16 variables! 


Algorithm: general case 


• For more sources we need more variables. 


• Example (3 sources, equal valences): 


x = As + Bs ° 2 + C 
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24 variables! 


Algorithm: general case 


Gradient of Ml can be generalized with the aid of the Kronecker 
product: 


A®B = 


a 1± B 

• • 

• • 
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• 
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Using implicit differentiation on the mixing model leads to: 


o=Jg^+[in®y T \i n ®y 
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i n ®vT 


" cross. 


-► Concatenation 


Works for any number of sources and valences! 
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Algorithm: general case 




A recurrent network can be developed by the 
same idea. 


The Jacobian Jg cannot be generalized due to the 
cross product terms. 

Newton-Rhapson root finding algorithm is not 
necessarily stable anymore. 



For real chemical data should probably be ok! 
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estimate estimate mixture 


Simulation: 3 sources, equal valence 
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SIR values: 20.0 dB 
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Simulation: 2 sources with different valences 



3 rd degree polynomial model 
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Conclusion 


• An extension to the algorithm proposed for a specific case has been 
presented and can be used for a broader range of source configurations. 

• Computationally more expensive. 

• Results not as accurate as obtained in the specific case, but the estimates 
are still reasonably good. 

• Algorithm can be extended for any number of sources and valences. 

• If polynomials of higher degree are used, possible problem with 
instability of recurrent network and/or ambiguity of solutions. 

• Chemical data should probably not have such problems (mixing 
coefficients are low) 


Thank you! 


Questions? 


